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Generalized evolutionary algorithm based on Tsallis canonical distribution is proposed. The 
algorithm uses Tsallis generalized canonical distribution to weigh the configurations for 'selection' 
instead of Gibbs-Boltzmann distribution. Our simulation results show that for an appropriate 
choice of non-extensive index that is offered by Tsallis statistics, evolutionary algorithms based on 
this generalization outperform algorithms based on Gibbs-Boltzmann distribution. 

PACS numbers: Valid PACS appear here 
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I. INTRODUCTION 

Evolutionary computation comprises techniques for 
obtaining near-optimal solutions of hard optimization 
problems in physics 0, and engineering These 
methods are based loosely on ideas from biological evo- 
lution and are similar to simulated annealing, except 
that instead of exploring the search space with a sin- 
gle point at each instant, it deals with a population 
- a multi-subset of search space - in order to avoid 
getting trapped in local optima during the process of 
optimization. Though evolutionary algorithms are not 
known generally as Monte Carlo methods, recently these 
algorithms have been analyzed in Monte Carlo frame- 
work [e.g.lllll. 

A typical evolutionary algorithm is a two step pro- 
cess: selection and variation. Selection comprises repli- 
cating an individual in the population based on proba- 
bilities (these are called selection probabilities) assigned 
to the individuals in the population on the basis of a "fit- 
ness" measure defined by the objective function. Stochas- 
tic perturbation of individuals while replicating is called 
variation. 

Selection is a central concept in evolutionary algo- 
rithms. There are several selection mechanisms in evo- 
lutionary algorithms, among which Boltzmann selection 
has an important place because of the deep connection 
between the behavior of complex systems in thermal equi- 
librium at finite temperature and multivariate optimiza- 
tion j7j. In these systems, each configuration is weighted 
by its Gibbs-Boltzmann probability factor e^^l^ , where 
E is the energy of the configuration and T is the tem- 
perature. Finding the low-temperature state of a system 
when the energy can be computed amounts to solving 
an optimization problem. This connection has been used 
to devise the simulated annealing algorithm |^. Simi- 
larly for evolutionary algorithms in the selection process 
where one would select "better" configurations, one can 
use the same technique to weigh the individuals i.e., using 



Gibbs-Boltzmann factor. This is called Boltzmann selec- 
tion, which is nothing but defining selection probabilities 
in the form of Gibbs-Boltzmann canonical distribution. 

Recently Tsallis and Stariolo Jjj proposed general- 
ized simulated annealing based on Tsallis statistics [lol| . 
This method is shown to be faster than both classi- 
cal simulated annealing and the fast simulated anneal- 
ing methods 0, ^|. This algorithm has been used 
successfully in many applications in Physics and Chem- 

istry [Illlllllllllla 

This is the motivation for us to incorporate Tsallis 

canonical probability distribution for selection in evolu- 
tionary algorithms instead of Gibbs-Boltzmann distribu- 
tion. To our knowledge this is the first attempt to use 
Tsallis probabilities in evolutionary computation and test 
the novelty of this technique using simulations. 

The outline of the paper is as follows. In §^ we review 
evolutionary algorithms based on Gibbs-Boltzmann dis- 
tribution and in § IIIII we present our algorithm based on 
Tsallis generalized distribution. We present simulation 
results in SIIVI 
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II. EVOLUTIONARY ALGORITHMS BASED 
ON GIBBS-BOLTZMANN DISTRIBUTION 

Let f2 be the search space i.e. space of all configu- 
rations of an optimization problem and let i? : 57 — *■ M 
be the objective function - following statistical mechan- 
ics terminology [e.g. 0, IT^ we refer to this function as 
energy (in evolutionary computation terminology this is 
called as fitness function) - where the objective is to find 
a configuration with lowest energy. Let P = {y>kYk=\ de- 
note a population which is a multi-subset of fJ. Here we 
assume that the size of population at any time is finite 
and need not be a constant. 

The general structure of evolutionary al gor ithm is 
shown in the FIGQ] for further details refer to |l8LIT9l |. In 
the first step, population P(0) is initialized with random 
configurations. At each time step t population undergoes 
the following procedure. 

P(t) selection variation jj^^ _j_ -|^^ 

Variation is nothing but stochastically perturbing the 
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premature convergence. This problem is well known from 
simulated annealing (21| , but not very well studied in evo- 
lutionary algorithms. Recently Mahnig and Miihlenbein 
[2^. Dukkipati et al. 23] proposed annealing schedules 
for evolutionary algorithms based on Boltzmann selec- 
tion. 




FIG. 1: Structure of evolutionary algorithms 

individuals in the population. Various methods in evolu- 
tionary algorithms follow different approaches. For ex- 
ample in genetic algorithms, where configurations are 
represented as binary strings, operators such as muta- 
tion and crossover are used; for details see Q ■ 

Selection is the mechanism, where the "good" config- 
urations are replicated based on their selection proba- 
bilities For a population P{t) — {i^k}k^i with the 
corresponding energy values {i?fc}fc=i, selection probabil- 
ities are defined as, 

pt{LUk) - Prob(tjfe e P'{t)\LOk e Pit)) yi = l...n , 

and satisfies the condition: 



(1) 



k=l 



According to Boltzmann selection, selection probabilities 
are defined as 
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where Pt is the inverse temperature at time t and {(3t ■ 
t = 0, 1 . . .} is an annealing schedule. The strength of 
selection is controlled by the parameter p. A higher value 
of P (low temperature) gives a stronger selection, and a 
lower value of (3 gives a weaker selection 20] . 

Boltzmann selection gives faster convergence, but 
without good annealing schedule for 7, it might lead to 



III. GENERALIZED EVOLUTIONARY 
ALGORITHM BASED ON TSALLIS 
PROBABILITIES 

Tsallis ^3 proposed a generalization of the celebrated 
Boltzmann-Gibbs entropy measure (Shannon entropy in 
information theoretic terms) which is defined as 



Sqip) 



.^-EkPk' 



q 



1 



(3) 



where p = {pk} is a probability distribution, q is called 
non-extensive index and is a conventional positive con- 
stant (we adopt k = 1 for simplicity). We have 



lim Sq{p) = ~y^Pk Inpfc = Si{p) 

q—^l ^ — ^ 
k 



(4) 



which is Shannon's entropy, i.e., in the q — > 1 limit, Sq 
recovers the Shannon entropy. Maximizing the Tsallis 
entropy Sq with the constraints 



1 and 
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where {Ek} is the energy spectrum. The generalized 
probability distribution is found to be [Tol |. 



Pk 



[1 - (1 - q)f3Ek] 
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with Zq as the partition function, 



Zq = Y,\\-{\-q)PEk\^^ 



(6) 



(7) 



where /? = is a Lagrange parameter called inverse tem- 
perature. This distribution is Tsallis generalized canoni- 
cal distribution '23. Note that 
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[1 - (1 - q)pEk\ 



(8) 



i.e., Tsallis distribution goes to the Gibbs-Boltzmann dis- 
tribution when q tends to 1. 

Inspired by these general statistics, we propose a new 
selection scheme for evolutionary algorithms based on 
Tsallis generalized canonical distribution. For a pop- 
ulation P{t) — {LiJk}k^i with corresponding energies 
{Ek}k=i we define selection probabilities as 



Pti^^k) 
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(9) 
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where {f3t : t = 1, 2, . . .} is annealing schedule. We refer 
selection scheme based on Tsallis distribution as Tsallis 
selection and evolutionary algorithm with Tsallis selec- 
tion as generalized evolutionary algorithm. 

In this paper we use the annealing schedule derived 
by Dukkipati et al. |23| which is called Cauchy anneal- 
ing schedule for evolutionary algorithms. According to 
this annealing schedule Pt should be a non-decreasing 
Cauchy sequence for faster convergence. In the non- 
decreasing Cauchy sequence is chosen as 

* 1 

Pt=f3oY.-^ i = l,2,... , (10) 

1=1 

where Pq is any constant, a > 1 and novelty of this an- 
nealing schedule had been demonstrated using simula- 
tions. Similar to the practice in generalized simulated 
annealing [e.g0|, in our algorithms q tends towards 1 as 
temperature decreases during annealing. 

The generalized evolutionary algorithm based on Tsal- 
lis statistics is listed in FIG.|5| 

Algorithm 1 Generalized Evolutionary algorithm 
P(0) ^ Initialize with configurations from 
search space randomly 
Initialize f3 and q 
for < = 1 to T do 
for all ij e P[t) do 
{Selection) 
Calculate 

^^^^ ^ [l-{l-q)pE{^)]^' 

Zq 

Copy uj into P'(t) with probability 
p(uj) with replacement 
end for 

for all u e P'{t) do 
( Variation) 

Perform variation with specific 
probability 
end for 

Update P according to annealing 
schedule 

Update q according to its schedule 

P{t + l)^P'{t) 
end for 



FIG. 2: Generalized Evolutionary Algorithm based on Tsallis 
statistics to optimize the energy function E{lj). 



IV. SIMULATION RESULTS 

We discuss the simulations conducted to study gen- 
eralized evolutionary algorithm based on Tsallis statis- 
tics proposed in this paper. We compare performance of 
evolutionary algorithms with three selection mechanisms 



viz., proportionate selection (where selection probabili- 
ties of configurations are inversely proportional to their 
energies 0), Boltzmann selection and Tsallis selection. 
For comparison purposes we study multi-variable func- 
tion optimization in the framework of genetic algorithms. 
Specifically, we use the following bench mark test func- 
tions 25] , where the aim is to find the configuration with 
lowest functional value: 

• Ackley's function: 

E,{x) = -20exp(-0.2y^i^5r~^) 

- exp( J Y.i=i cos(27rXi)) + 20 + e, 
where — 30 < < 30 

• Rastrigin's function: 

E2ix) = IA + J2[^^x^ ~ A cos{2nx,), 
where A = 10 ; -5.12 < < 5.12 

• Griewangk's function: 

i^3(x) = EUi^-nUcos(^)-Hi, 

where -600 < a;, < 600 

Parameters for the algorithms were set to compare 
performance of these algorithms in identical conditions. 
Each Xi is encoded with 5 bits and I = 15 i.e., search 
space is of size 2^^. Population size is n = 350. For all 
the experiments, probability of uniform crossover is 0.8 
and probability of mutation is below 0.1. We limited each 
algorithm for 100 iterations and we have given the plots 
for behavior of the process when averaged over 20 runs. 

As we mentioned earlier, for Boltzmann selection we 
have used Cauchy annealing schedule (see ifTUI) ) and 
Po = 200 and a = 1.01. For Tsallis selection too we have 
used the same annealing schedule as Boltzmann selection 
with identical parameters. In our preliminary simula- 
tions q was kept constant and tested with various values. 
Then we adopted a strategy from generalized simulated 
annealing where one would choose an initial value of qo 
and decrease linearly to the value 1. This schedule of q 
gave better performance than keeping it constant. We 
reported results with various values of go- 

From various simulations we observed that when the 
problem size is small (for example smaller values of I) all 
the selection mechanisms perform equally well. Boltz- 
mann selection is effective when we increase the prob- 
lem size. The novelty of Cauchy annealing schedule for 
Boltzmann selection is shown in ^2§\. For Tsallis selec- 
tion we performed simulations with various values of ^q. 
FIG. 121 shows the performance for Ackley function for 
qo = 3,2,1.5 and 1.01 from which one could conclude 
that the choice of go is very important for evolutionary 
algorithm with Tsallis selection which varies with prob- 
lem at the hand. 

FIG. 01 Inland show the comparisons of evolutionary 
algorithms based on Tsallis selection, Boltzmann selec- 
tion and proportionate selection for different functions. 
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FIG. 3: Performance of evolutionary algorithm with Tsallis 
selection for various values of go for the test function Ackley 



FIG. 6; Griewangk: qo = 1.01 
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FIG. 4: Ackley: qo = 1.5 
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FIG. 5; Rastrigin; qo ^ 2 



We have reported only the best behavior for various val- 
ues of qq. From these simulation results we conclude 
that the evolutionary algorithm based on Tsallis canoni- 
cal distribution with appropriate value of qo outperform 
algorithms based on Boitzmann and proportionate selec- 
tion. 



V. CONCLUSION 

Inspired by generalization of simulated annealing re- 
ported by Tsallis and Stariolo 0, in this paper we 
proposed a generalized evolutionary algorithm based on 
Tsallis statistics. The algorithm uses Tsallis canonical 
probability distribution instead of Gibbs-Boltzmann dis- 
tribution. 

We tested our algorithm on bench-mark test func- 
tions. We found that with an appropriate choice of non- 
extensive parameter (q), evolutionary algorithm based 
on Tsallis statistics outperforms evolutionary algorithms 
based on Gibbs-Boltzmann distribution. We believe the 
Tsallis canonical distribution is a powerful technique for 
selection mechanism in evolutionary algorithms. Evolu- 
tionary algorithms have been analyzed in the past using 
statistical mechanics ^3 IIE US j therefore anal ysis 
of the same using non-extensive statistical mechanics |29l | 
would be very welcome. 
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